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Stochastic local search (SLS) has been an active field of research in the last few years, with new tech- 
niques and procedures being developed at an astonishing rate. SLS has been traditionally associated 
with satisfiability solving, that is, finding a solution for a given problem instance, as their intrinsic 
nature does not address unsatisfiable problems. Unsatisfiable instances were therefore commonly 
solved using backtrack search solvers. For this reason, in the late 90s Selman, Kautz and McAllester 
proposed a challenge to use local search instead to prove unsatisfiability. More recently, two SLS 
solvers - RANGER and GUNSAT - have been developed, which are able to prove unsatisfiability al- 
beit being SLS solvers. In this paper, we first compare RANGER with GUNSAT and then propose 
to improve RANGER performance using some of GUNSAT's techniques, namely unit propagation 
look-ahead and extended resolution. 

1 Introduction 

Selman, Kautz and McAllester posed an intriguing challenge in 1997 to use local search to prove un- 
satisfiability rather than satisfiability lITSl . In 2006 and 2007, two different approaches were proposed 
in response to that challenge HHm. These two algorithms - RANGER [14] and GUNSAT 121 - use lo- 
cal search to prove unsatisfiability instead of satisfiability, still being incomplete algorithms. They can, 
however, prove that a formula is satisfiable under certain conditions. 

Previous work has addressed the use of hybrid algorithms combining clause learning with local 
search to prove either satisfiability or unsatisfiability |[T5l |9l [lOl at the cost of having worst-case expo- 
nential space complexity. Alternative approaches combined unit clause elimination and local search fTOll. 

We should note, however, that the algorithms just mentioned clearly differ from RANGER and GUN- 
SAT, which were built with the main goal of proving unsatisfiability by (directly or indirectly) deriving 
the empty clause. The main idea is to apply a sequence of resolution steps and other satisfiability pre- 
serving techniques to conclude that the formula has no solution. 

Although based on the same ideas, RANGER and GuNS AT differ. RANGER is a lightweight algorithm 
that performs many moves per second, while GUNS AT applies more powerful reasoning techniques. This 
paper presents for the first time a detailed comparison of these two algorithms and further integrates some 
of GUNSAT techniques into RANGER. 

This paper is organised as follows. The next section provides the required background. Section [3] 
describes and compares RANGER and GUNSAT. Afterwards, we describe the integration of GuNSAT's 
techniques into RANGER. Section[5]provides the experimental evaluation of the new techniques. Finally, 
the paper concludes. 
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2 Background 

We assume the basic definitions in the context of prepositional satisfiability. A prepositional formula (p 
is a conjunction of clauses, where a clause c is a disjunction of literals and a literal / is either a variable 
or its negation, being either a positive or a negative literal, respectively. Each variable v can be assigned 
a truth value (true or false, also often referred to as 1 or 0, respectively). A positive literal / is said 
to be satisfied (unsatisfied) if the corresponding variable is assigned value true (false). A negative 
literal / is said to be satisfied (unsatisfied) if the corresponding variable is assigned value false (true). 
A clause is said to be satisfied if at least one of its literals is satisfied, unsatisfied if all of its literals 
are unsatisfied and unresolved otherwise. Unresolved clauses with only one unassigned literal are said 
to be unit. A formula is satisfied if all of its clauses are satisfied. The propositional satisfiability (SAT) 
problem consists in deciding whether there exists a truth assignment to the variables such that the formula 
becomes satisfiable. Such an assignment is called a solution. 

Two of the most well-known complete algorithms for SAT, which both still inspire current state of the 
art algorithms, are the Davis-Putnam (DP) [7] and the Davis-Logemann-Loveland (DLL) [6] algorithms. 
The first one is based on the resolution principle lfT6l . whereas the second one is based on backtrack 
search. An important feature on a backtrack search algorithm for SAT is the use of unit propagation. 
Clearly, a unit clause has only one way to be satisfied, which implies satisfying its unassigned literal. 
This rule may be iteratively applied until no unit clauses remain in the formula. 

Local search algorithms, in contrast, are incomplete as they are not able to prove unsatisfiability: 
either they find a solution or the answer is unknown, which means that either the formula has no solution 
or the solver was not able to find a solution in the allowed CPU time. 

Local search algorithms start at some location in the given problem's search space and then move 
from the start location to a neighbouring location in the search space which is determined by a decision 
based on local knowledge only. These local search algorithms are typically incomplete, that is, there 
is no guarantee that an existing solution will be found, and if no solution exists that fact can never be 
determined with certainty. Furthermore, these search methods can visit the same location in the search 
space more than once, and they can become trapped in a small number of locations from which they 
cannot escape: these are called local minima, which will be discussed shortly, and require special escape 
strategies. 

Many widely known and high-performance local search algorithms make use of randomized choices 
when generating and/or selecting candidate solutions for a given problem ifTTTl . These algorithms are 
called stochastic local search (SLS) algorithms, and they belong to the most powerful methods for prac- 
tically solving large and hard satisfiable instances of SAT, and outperform the best systematic search 
methods on a number of domains. In SLS algorithms, the initial position in the search space is chosen 
randomly, as are the decisions to move from a position to another. Two early but influential stepping 
stones in SLS algorithm development are GSAT |[T9l and WalkSAT lEl. 

3 Local Search for Unsatisfiability 

Ranger and Gunsat are two stochastic local search algorithms which resemble the skeleton of SLS 
algorithms, but on the other hand aim at deriving the empty clause to prove unsatisfiability. 

3.1 Ranger 

Ranger |[T4l stands for RANdomized GEneral Resolution and was presented in 2006 as the first SLS 
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algorithm that can prove unsatisfiabiUty rather than satisfiabihty. It explores a space of multisets of 
resolvents using general resolution and aims at deriving the empty clause non-systematically but greedily, 
thus proving unsatisfiabiUty. RANGER will eventually refute any unsatisfiable instance while using only 
bounded memory. 

A theoretical result behind the exploration of local search on multisets of resolvents can be found 
in im. The authors show that the space needed for a resolution proof is no more than n + l resolvents, 
where n is the number of variables in the problem. 

Given an unsatisfiable SAT formula (p with n variables and m clauses, a general resolution refutation 
can be represented by a series of formulae (pi,...,(ps where <pi consists of some or all of the clauses in (p, 
and (ps contains the empty clause. Each cpi is obtained from by (optionally) deleting some clauses 
in (pi-i, adding the resolvent of two clauses in <p,-i, and (optionally) adding clauses from (p. The space 
of a proof is defined as the minimum k such that each (p, contains no more than k clauses. 

Intuitively, each 9, represents the set of active clauses at step / of the proof. Inactive clauses are not 
required for future resolutions, and after they have been used as needed they can be deleted (for example 
clauses that are subsumed by others). 

The width of a proof is the length (in literals) of the largest clause in the proof. Any non-tautologous 
clause must have length no greater than n, so this is a trivial upper bound for the width used in RANGER. 
However, in practice, it may succeed even if the resolvent length is restricted to a smaller value, which 
will save memory on large problems. Each <p, will be of the same constant size, and derived from 
by the application of resolution or the replacement of a clause by one taken from (p. 

The architecture of RANGER is shown in algorithm [T] It has six parameters: the formula cp, three 
probabilities pt, pt and pg, the width w and the size k of the formula 9,. 

The Ranger algorithm begins by choosing any k clauses from the formula (p into (pi. It then 
performs / iterations, either replacing a (pi clause with a (p clause (with probability /?,) or resolving two 
(Pi clauses and placing the result r into <p,. In the latter case, if r is a tautology or contains more than 
w literals then it is discarded and <p,+i = (p,. Otherwise a 9, clause must be removed to make room for 
r. either (with probability pg) the removed clause is the longer of the two parents of r or it is randomly 
chosen. In the former case, if r is longer than the parent then r is discarded and = (p,. With 
probability pt any satisfiability-preserving transformation may be applied to (p, cpi or both. One can 
apply subsumption and the pure literal rule in several ways as satisfiability-preserving transformations. 
If the empty clause has been derived then the algorithm returns Unsatisfiable, otherwise it may not 
terminate. A time-out condition may be added to restrict the CPU time that the algorithm is allowed to 
run. 

In this algorithm the goal is to derive the empty clause, and as such (p, must contain some small 
clauses. This is controlled by the level of greediness (probability pg). A greedy local move is one that 
does not increase the number of literals in (p,. So, increasing pg will increase the greediness of the search, 
reducing the proliferation of large resolvents. 

Ranger has a useful convergence property: for any unsatisfiable SAT problem with n variables 
and m clauses, it finds a refutation if pi > 0, pi,pt,Pg < I, w = n and k>n-\-l. For a proof, see |[T4ll . 
The space complexity of RANGER is 0{n + m + kw). To guarantee convergence, it requires w = n and 
k>n-\-l so the space complexity becomes at least O [m + . In practice, it may require k to be several 
times larger, but a smaller value of w is usually sufficient. 

It should be noted that RANGER performs very poorly on unsatisfiable random 3-SAT problems. This 
is an interesting asymmetry, given that local search performs well on satisfiable random problems. This 
may be because such refutations are almost certainly exponentially long ||51. 
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Input : formula (p in CNF, pi, p,, pg,w,k 
Output: Unsatisfiable or Unknown 
for try = 1 to maxTries do 

/ = 1 and (p\ ={any k clauses from (p} 

for step = 1 to maxSteps do 

if (pi contains the empty clause then 
return Unsatisfiable 

end 

with probability pi 

replace a random <p, clause by a random (p clause 

end 

otherwise 

resolve random (pi clauses c,c' giving r 
if r is non-tautologous and |r| < w then 
with probability pg 

if \r\ < max{\c\, \c'\) then 

I replace the longer of c,c' by r 
end 

end 

otherwise 

I replace a random (jp,- clause by r 
end 

end 

end 

with probability pt 

apply any satisfiability-preserving transformation to (p,(pi 

end 

i = i+ \ and ={the new formula} 

end 

end 

return Unknown 

Algorithm 1: The RANGER algorithm 



3.2 GUNSAT 

GUNSAT ||2l proposes to make a greedy walk through the resolution search space in which, at each 
iteration of the algorithm, it tries to compute a better neighbouring set of clauses, i.e. a set of clauses 
similar to the previous one, differing from the previous one by at most two clauses: one added by 
resolution and one that may have been removed. Intuitively, it will add new clauses and remove existing 
ones to the formula, trying to derive the empty clause by using the resolution rule. 

Guns AT is depicted in algorithm [2] It either proves that a problem instance is UNSATISFIABLE or, 
if it does not derive an empty clause within maxTries then it returns UNKNOWN. Also, if GUNSAT fails 
to derive the empty clause after maxSteps a restart is performed. By then all clauses, except vital and 
binary clauses, are removed. Vital clauses are initial clauses, or any clause that previously subsumed 
another vital clause. They ensure that the unsatisfiability of the formula is preserved. 
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Input : formula (p in CNF 


Output: Unsatisfiable or Unknown 


for try = 1 to maxTries do 




for step = 1 to maxSteps do 






if 2-saturation((p) returns UNSATISFIABLE then 






1 return Unsatisfiable 






end 






if (p > MaxSize then 






remove-one-clause{(p) 






end 






add-one-clause{(p) 






add-extended-variables{(p) 






simplify-look-ahead{(p) 




end 




replace (p by all its vital and binary clauses 


end 




return Unknown 



Algorithm 2: The GUNSAT algorithm 



GUNSAT operates on an initial formula <p through a few operations: 2-saturation, remove-one-clause, 
add-one -clause, add-extended-variables and simplify -look- ahead. Some of these operations depend on 
a powerful scoring scheme. A score is given to all pairs of literals based on their frequency appearance 
in the formula. Let us consider a clause c; of length Each pair {hjh) appearing in c,- is credited a 
weight of W2 («,) = J'i) ■ The score of a pair of literals (Zi , I2) is defined as the sum of its weights in 
all clauses and noted S{l\,l2)- The score S{c) of a clause c is the sum of the scores of all the pairs of 
literals it contains. 

The 2-saturation step ensures that, each time a new binary clause is added to cp, all resolution opera- 
tions between the set of binary clauses are performed to saturate (p. In order to exploit their full power, 
an equivalency literal search is performed. While performing the binary clause saturation, the algorithm 
may find new unit clauses (note that in a resolution step between two binary clauses the resolvent can 
have either one or two literals). The literal / of the unit clause is then propagated in the whole formula 
by unit propagation. An inconsistency may be identified at this step and the algorithm returns UNSAT- 
ISFIABLE, proving the unsatisfiability of the formula. Refer to for the use of binary clause saturation 
for preprocessing purposes. 

In addition, if the size of the current formula is greater than a fixed MaxSize then a non- vital clause 
is removed by remove-one-clause. In each iteration there is also a call to add-one -clause, which adds 
one clause to the current formula according to the scoring scheme. Both add-extended-variables and 
simplify -look-ahead use reasoning mechanisms (extended resolution in the former, unit propagation look- 
ahead in the latter) to improve the chances of deriving an empty clause in the next iteration. Add- 
extended-variables adds the three clauses generated through extended resolution to the formula. Simplify- 
look-ahead applies unit propagation look-ahead to the formula |[T2l . which may eventually conclude the 
formula is unsatisfiable. 

Extended resolution is applied when the algorithm has tried to increase the score of a given pair of 
literals too many times without success, and it uses extended resolution to artificially increase that score. 
The application of the extended rule implies adding a new variable e and three clauses to the formula. In 
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practice, e <^ liV his encoded by the three clauses {-leV hV h), {eV -i/i) and {e V -'h)- 

Look-ahead techniques are used to detect equivalences between literals until an inconsistency is 
found. Guns AT uses look-ahead unit propagation on pairs of literals, such that the four possible pairs of 
values are propagated in <p, potentially implying more propagations. 

3.3 Ranger vs. Gunsat 

There are some few important differences between these two local search algorithms for proving unsat- 
isfiability. RANGER generates a large number of the shortest possible clauses as fast as possible, using 
unintelligent local moves, whereas GuNSAT takes longer to make more intelligent moves based on a 
more complex objective function. GuNSAT also uses higher reasoning techniques like extended reso- 
lution and unit propagation look-ahead (RANGER uses only general resolution). Also, unlike GuNSAT, 
Ranger uses a mechanism to ensure bounded memory. 

4 Improving Ranger 

This section describes the implementation of unit propagation look-ahead and extended resolution in 
Ranger. We should note that before starting to implement new features into the solver we made a 
series of modifications to the original tool in terms of data structures to better accommodate our needs. 
For the new techniques, it is required to have a complete knowledge of a clause status, namely to identify 
whether it is satisfied, unsatisfied or unresolved, in which case is important to distinguish unit clauses. 

4.1 Implementing Unit Propagation Look- Ahead 

The solver GUNSAT successfully uses a method dubbed unit propagation look-ahead |I3 to improve its 
basic algorithm. The Uterals of the formula under consideration are extensively checked to see if there 
are any conflicts arising from hypothetical assignments. 

Gunsat implements a version of the unit propagation look-ahead which uses two variables. These 
two variables are then assigned a value such that the four possible combinations are covered. If Vi and V2 
are our variables, then the four possible combinations are: (1) Vi = and V2 = 0, (2) Vi = and V2 = 1, 
(3) Vi = 1 and V2 = 0, and (4) Vi = 1 and V2 = 1. 

Given an assignment to a pair of variables, a conflict is identified when one of the clauses becomes 
unsatisfied as a result of unit propagation. For each iteration of this look-ahead method, i.e., for each 
combination of variable assignments, we store the value of each variable in the formula, only if that 
variable is forced to be assigned as a result of unit propagation (note that these assignments are only 
temporary, done for each iteration of the look-ahead and stored only for the duration of the look-ahead 
for the two variables). But in RANGER we have further extended this technique. 

Let us consider the assignments which were implied by unit propagation after assigning a pair of 
variables. We may further consider intersections of implications when taking into account different 
assignments made to the variables in that pair. We should now focus on the number of conflicts after the 
application of the unit propagation look-ahead technique after assigning a pair of variables. In the worst 
case, we may end up with four conflicts, one for each of the four different assignments for a given pair 
of variables. (Note that the method to be applied resembles the Stalmark's method EH and has been 
applied to CNF formulas in the past iflBl .) Overall, we have five possible scenarios: 
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• Zero conflicts: If there are no conflicts, we will consider all four combinations when computing 
the intersection. If a variable is assigned the same value through all combinations, then that value 
will be assigned and the unit clause rule will be applied. 

• One conflict: 

- The intersections will be calculated, but now only considering the combinations that did not 
yield a conflict (three in this case). Again, if a variable is assigned the same value through the 
three combinations, then that value will be assigned and the unit clause rule will be applied. 

- A binary clause is added to the formula: this clause results from the negation of the assign- 
ments that yield a conflict. 

• Two conflicts: 

- As above, the intersections will be calculated, but only considering the combinations that did 
not yield a conflict (two in this case). This may result in new unit clauses. 

- Two binary clauses are added to the formula, resulting each one from the negation of the 
assignments that yield a conflict. There is a special case where only one unit clause is 
added, which happens when a variable assignment is repeated in both conflicts (the two 
binary clauses are resolved to generate the unit clause). 

• Three conflicts: 

- The values that were assigned in the only combination that did not yield a conflict will be 
propagated as a result of the two unit clauses being added, each one with each the variable 
assignment that did not yield a conflict. 

• Four conflicts: The formula yields a conflict for all combinations, which means that the formula 
is unsatisfiable. 

Example 1 To illustrate the look-ahead behaviour o/GUNSAT suppose we have the following formula 
(p with the clauses: 

C\ = (Vi VV2 V V3) 

C2 = (vi v^ViVva) 

C3 = (^Vi VV3) 
C4 = (V3 V ^V4) 

Clearly, for any of the possible assignments to V\ and V2 the value ofv^ must be 1. Thus, we have 
that V3 must be assigned value 1, regardless of the assignments made to other variables, and the clause 
C5 = (V3) can be added to the formula as a unit clause. We can then perform unit propagation. 

Example 2 The unit propagation look-ahead can also be used to derive an empty clause. Suppose we 
have the following formula cp: 

ci = (Vi VV2) 

C2 = (-'Vl VV2) 
C3 = (^V2 VV3) 
C4 = (^V2 V^V3) 

If we consider V2 = 1, then either clause C3 or C4 becomes unsatisfied. On the other hand, if we 
consider V2 = 0, then either clause ci or C2 becomes unsatisfied. Therefore, there is no assignments to 
variable Vi to make the formula satisfied and as such we conclude that it is unsatisfiable. (In this case, 
there was no need to consider pairs of assignments to reach such a conclusion.) 
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One of the objectives of this paper is to successfully integrate features of the GUNSAT algorithm 
into the Ranger algorithm. We do not want, however, to modify the most important properties of 
the original RANGER, nor alter its flow. The unit propagation look-ahead was, thus, added to the step 
of satisfiability-preserving transformations. The probability, Pt, to execute these transformations is 90%, 
and like the other transformations, unit propagation will be executed, on average, in 90% of the iterations 
of the algorithm. 

This procedure has been divided into two parts: unit propagation look-ahead with pairs of literals and 
unit propagation look-ahead with only one literal. The first one is only executed once, the first time that 
satisfiability-transformations are executed, due to the overhead it has on the performance of the solver. 
The second part of this procedure, which is less expensive, is executed in every satisfiability-preserving 
transformation. 

Finally, note that these methods can prove the unsatisfiability of a formula themselves: if all possible 
assignments to a pair of variables result in conflicts then the formula is unsatisfiable; likewise, if for both 
possible assignments to a variable a conflict is detected, the algorithm also returns UNSATISFIABLE. It 
is also possible to find a solution during this step, though this occurs less frequently. 

4.2 Implementing Extended Resolution 

The way extended resolution is used in Gunsat is intrinsically related to the algorithm itself, built to 
take advantage of its scoring scheme. Note that extended resolution is only used when the algorithm has 
tried to increase the score of a pair of literals too many times without success. It is very different from 
the way RANGER operates, where no scoring scheme for literals is used. Thus, we had to add GuNSAT's 
scoring scheme to RANGER to implement extended resolution in the same way it was successfully used 
in GUNSAT. 

But there is a problem with this approach. GUNSAT's scoring system for pairs of literals is part 
of the main heuristic of the solver. It was developed to be the backbone of the algorithm and to be a 
highly refined heuristic of scoring for choosing the best literals and clauses to resolve. Methods like 
extended resolution, unit propagation look-ahead or binary clause saturation are only meant to improve 
this heuristic. 

In the previous section, we described the way in which unit propagation look-ahead, a method also 
used in GuNSAT and which proved to yield successful results, was added to the original Ranger. 
But this method was not intrinsically linked to the base of Gunsat, as extended resolution is. One 
could simply add it as a preprocessing technique, or run it as a satisfiabiUty preserving transformation to 
Ranger without loss of identity. 

Even though adding extended resolution to Ranger seemed to be neither more efficient nor an 
easy task, and although it did not promise to integrate well with the already implemented algorithm and 
methods, we tried to integrate it with RANGER and to improve its performance on unsatisfiable instances. 
As said above, RANGER does not have a scoring scheme for literals like GuNSAT does, so that extended 
resolution could be applied directly to that scheme and be integrated seamlessly in the algorithm. Instead, 
we chose to adapt the scoring method of GUNSAT to Ranger and thus apply the extended resolution in 
the same way GuNSAT does. 

Extended resolution is executed only during the satisfiability-preserving transformations phase of the 
Ranger algorithm, in the same way as unit propagation look-ahead with one variable is, and for the 
same reason: we did not want to alter Ranger's base concept and program flow. Furthermore, besides 
the probability Pt of this phase of the algorithm, we inserted another probabifity Per, and the steps of 
extended resolution will only be executed according to this probabifity. We had some trouble finding an 
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appropriate number for this probability, mostly because, in the GUNSAT paper 121 the authors write that 
extended resolution is used after the algorithm has tried to increase the score of a given pair of literals 
"too many times", but do not provide details. We chose = 5% which means it will be executed in 
about 4.5% of the iterations (calculated by multiplying the 90% chance that the satisfiability-preserving 
transformations phase will be run and the 5% chance that extended resolution will be executed within 
that phase). 

At the start of each phase of extended resolution, our algorithm will compute the scores for all the 
pairs of literals in the working formula, in the same way that GUNSAT calculates its scores: each pair of 
literals {h^h) appearing in the formula is credited a score computed by adding the score of each literal 
in each clause c, according to the following formula: ■ We compute the score of each variable in 

each clause and add them for each pair of literals. The score of a clause is then computed by summing 
the scores of all the pairs of literals it contains. Finally, we calculate the score of each quadruplet by 
adding the sum of the squares of the scores of its pairs of literals. 

After the scores have been computed, we continue to follow GuNSAT's heuristic to improve the score 
of a pair of literals (note that extended resolution will only be applied if we cannot improve the score 
of a pair of literals after too many times). The best scored quadruplet in the formula is computed and 
found, containing the literals Zi and I2. We then try to find a new clause with both l\ and I2 by searching 
the working formula for two clauses: one containing l\ and a pivot literal p, and the other containing 
I2 and the complement of the pivot literal, -1/7, such that the resolution rule can be performed and the 
needed clause with l\ and I2 is generated. We only try to generate the new clause c from the two clauses 
having the lowest scores. Because of this restriction, it is not always possible to generate a new clause 
according to the specified conditions (the cause could simply be that the new clause may be subsumed 
by an already existing clause, or it may be a tautology). If the score of one pair of the highest scored 
quadruplet cannot be improved, the other scores of the same quadruplet are iteratively tried. If no pairs 
of hterals in this quadruplet can be improved, the second best scored quadruplet is tried and so on. 

Finally, the algorithm checks, for all pairs of literals, whether their score has been increased too many 
times without any success or not. We set this value to 20, i.e., we consider the score of a pair of literals 
to be increased too many times when that value reaches 20. If this occurs for literals l\ and h then three 
new clauses will be added along with a new variable e: 

ci = (^eV/i V/2) 
C2 = (eV-/i) 
C3 = {ey^h) 

As we can see, there is a lot of implementation work needed to add this method to RANGER, espe- 
cially if we apply it in the same way GUNS AT does. Computing the scores and looking for the new clause 
is very demanding for the algorithm, and we are adding an additional layer of complexity to RANGER, 
whereas in GuNSAT this computation was already part of the algorithm itself. 

5 Experimental Evaluation 

This section illustrates the behaviour of RANGER on a set of problem instances. The instances consist of 
two benchmarks Q 

• The aim benchmark instances are all generated with a particular random 3-SAT instance gener- 
ator ||T|. Its primary role is to provide instances that the conventional random generation cannot 

'Available from www . cs .ubc . ca/~hoos/SATLIB/benchm.html. 
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Instance 


#instances 


#variables 


#clauses 


aim — 50 — no — 1 _6 


4 


50 


80 


aim — 50 — no — 2_0 


4 


50 


100 


aim — 100 — no — 1 _6 


4 


100 


160 


aim — 100 — no — 2_0 


4 


100 


200 


aim — 200 — no — 1-6 


4 


200 


320 


aim — 200 — no — 2_0 


4 


200 


400 


mm/50 -218 


100 


50 


218 



Table 1 : Characteristics of each set of problem instances 



generate. The generator runs in a randomized fashion, so that it is essentially different from those 
generated deterministically, or those translated from other problems such as graph colouring. We 
utilized three sets of unsatisfiable aim problem instances. Each set has either 50, 100 or 200 vari- 
ables, and within each set we have two groups: four instances where the ratio clause/variable is 
1.6, and another group of four instances for which the ratio is 2. 

• The uuf 50-218 benchmark consists of unsatisfiable uniform random 3-SAT instances. For an 
instance with n variables and k clauses, each of the k clauses has three literals which ai^e randomly 
picked from the 2n possible literals (the n variables and their negations) such that each possible 
literal is selected with the same probability. Clauses are discarded either if they contain repeated 
literals or a literal and its negation (i.e. tautologous clauses). We considered the data set of 100 
unsatisfiable instances with 50 variables and 218 clauses, dubbed data set uuf 50-218. 

Table [5] illustrates the characteristics of each set of problem instances, providing for each of them the 
number of instances, variables and clauses. 

We used the CPU time (in seconds) that each instance requires to be solved by a given tool as a 
measure of performance, as well as the number of iterations it takes to solve the instance. To better illus- 
trate the usefulness of each component added to RANGER, each problem instance was run with different 
versions of Ranger: the original Ranger code as a basis for comparisons (Original); Ranger with 
unit propagation look-ahead (UPLA); and RANGER with both unit propagation look-ahead and extended 
resolution (UPLA-i-ER). Results for GUNSAT were also collected. 

The results were obtained in an Intel Xeon 5160 server (3.0GHz, 1333Mhz, 4GB) running Red Hat 
Enterprise Linux WS 4. Each problem instance was given a timeout of 1000 seconds. Results for each 
instance were obtained from 10 runs using 10 different seeds. 

Tables [5] [5] and |5] show the results of, respectively, the percentage of instances solved, the CPU time 
taken to solve each set of instances and the median number of iterations performed by each solver (only 
taking into account the successful runs). The CPU time reported was computed as follows: first, for each 
instance was considered the mean time of the successful runs; second, the average of the given results for 
each instance in a set of instances was computed. The number of iterations are not reported for GUNSAT 
given that such information is not provided by the tool. 

From these tables, we conclude that the best solver for solving easier instances with few variables and 
a low ratio of variables/clauses is the original RANGER due to its simplicity. For all the other instances 
of the aim family, RANGER with unit propagation look-ahead beats the other two RANGER variants in 
terms of percentage of instances solved, required time and number of iterations, and is comparable with 
Guns AT. For the uuf 50-218 set of instances, GuNSAT is far superior to RANGER in any of its forms. 
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% of instances solved 


Instance 


Original 


UPLA 


UPLA+ER 


GUNSAT 


aim — 50 — no — 


1_6 


100 


100 


100 


100 


aim — 50 — no — 


2 


75 


100 


100 


100 


aim — 100 — no — 


1_6 


100 


100 


100 


97.5 


aim — 100 — no — 


2_0 


100 


100 


100 


100 


aim — 200 — no — 


1_6 


75 


77.5 


55 


80 


aim — 200 — no — 


2 


55 


66.2 


37.5 


80 


mm/50 -218 




20 


52.5 


5.7 


59.3 



Table 2: Percentage of instances solved by Ranger variants and Gunsat 





Time (seconds) 


Instance 


Original 


UPLA 


UPLA+ER 


Gunsat 


aim - 


- 50 — no — 


1_6 


0.015 


0.096 


0.281 


1.21 


aim- 


- 50 — no — 


2_0 


250.026 


0.114 


0.384 


1.41 


aim — 


100 - no - 


1_6 


0.834 


0.91 


13.57 


36.96 


aim — 


100 - no - 


2_0 


11.35 


1.74 


24.09 


3.27 


aim — 


200 -no - 


1_6 


259.227 


24.56 


317.1 


16.72 


aim — 


200 -no - 


2 


512.156 


238.7 


818.2 


379.8 


mm/50 -218 




845.6 


521.6 


740.1 


67.39 



Table 3: CPU time results for the Ranger variants and Gunsat 



Not surprisingly, extended resolution proved to be too heavy for Ranger's rather simple algorithm, 
and did not produce good results. The strength of Ranger lies in being simple enough to perform 
many moves per second and that makes up for the rather simple and somehow unintelligent but fast 
heuristics used. On the other hand, extended resolution, while being a simple technique to implement, is 
used in GUNSAT to improve its scoring scheme, which is a heavy feature of the algorithm and is finely 
adjusted for optimum performance. By implementing part of this scoring scheme in RANGER with the 
only goal of adding extended resolution to the algorithm, we actually went against Ranger's principles 
of simphcity, and thus the results achieved suggest not to use extended resolution when Ranger is 
concerned. 

Thus we can conclude that adding simple and fast techniques to Ranger is a viable option when 
trying to improve its base algorithm. These methods should not rely on scoring schemes, nor depend 
too much on certain conditions to be met: they must be independent and simple. This is based on the 
fact that they will be added to Ranger on its satisfiability -preserving transformation phase, and will not 
alter the basic algorithm significantly. 



6 Conclusions and Future Work 



This paper evaluates the usefulness of integrating native techniques to Gunsat into RANGER, another 
SLS solver able to prove unsatisfiability. We first tested both the original Ranger and GUNSAT in 
a number of unsatisfiable instance sets, in which Gunsat proved to be faster in the harder instances 
by systematically beating Ranger. This is mostly due to the fact that GUNSAT has a more powerful 
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Number of iterations 


Instance 


Original 


UPLA 


UPLA+ER 


aim 


-50- 


no — 


1_6 


39,223 


4,201 


4,958 


aim 


-50- 


no — 


2_0 


67,105 


6,240 


7,026 


aim - 


-100- 


-no- 


-1_6 


433,398 


134,572 


120,122 


aim - 


-100- 


-no- 


-2_0 


3,266,805 


160,971 


174,131 


aim - 


-200- 


-no- 


-1_6 


5,902,875 


1,390,580 


1,788,612 


aim - 


-200- 


-no- 


-2_0 


9,802,581 


3,066,713 


3,762,236 


mm/50 


-218 




174,752,209 


43,620,471 


5,139,0176 



Table 4: Number of iterations for the RANGER variants 



reasoning mechanism and a finer heuristic to guide moves, whereas RANGER is simpler. Because of the 
use of powerful high reasoning techniques like unit propagation look-ahead and extended resolution, and 
a finer heuristic, GuNS AT's moves are slower but more intelligent and pondered, in contrast to Ranger's 
rather faster but blinder moves. 

The integration of GUNSAT's techniques into Ranger, namely unit propagation look-ahead and ex- 
tended resolution resulted in improving Ranger's performance overall with the first technique, whereas 
the second one has degraded Ranger's performance. 

Future work includes further investigating why extended resolution impede the basic version of 
Ranger and using automatic methods to tune parameters, namely Per, such as the F-race proposed by 
Birattari et al. [4i . 
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